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Abstract 

Here we review the approach to glassy systems based on the replica method and we 
introduce the main ingredients of replica symmetry breaking. We explain why the replica 
method has been successful in spin glass and why it should be successful for real glasses. 

1 Introduction 

The idea that glasses and spin glasses have something in common (beyond the name) is often 
stated in the literature. We can hope that the progresses that have been done in these last 
20 years in the study spin glasses can be exported to glasses [1, 2, 17]. Many of these pro- 
gresses have been done using the replica method with the assumption of spontaneous symmetry 
breaking. 

The aim of this note is to describe the foundations of the replica method and to show why 
glasses are well inside its scope. It is organized as follows: in section II we review the replica 
method and we introduce the formalism of replica symmetry breaking. In section III we recall 
some mean field results that have been obtained for infinite range generalized spin glasses. In 
section IV we present some considerations on real glasses and in section V we explain why 
the replica method should work for real glasses. Finally in the appendix we present a first 
computation of the properties of a soft sphere glass using the replica method. 

2 The replica method 
2.1 Why replicas 

If we deal with systems which order in a simple way at low temperature (i.e. crystal forming 
materials, ferromagnets), the life is simple: we have to find the ground state and study the 
fluctuations around the ground state. 

The situation is much more difficult when the for one reason or another (intrinsic random- 
ness, chaotic dependance on the size of the system) the ground state is not known. In this 
case it is convenient to introduce replicas of the system. For example in spin glasses, where 
the fundamental variables are Ising spins which are defined on the points of the lattice, one 
introduces n replicas of the same system [1, 2], with Hamiltonian 

H= E H[o»]. (1) 

a=l,n 
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Let us consider the case where at low temperature the system develops a spontaneous 
magnetisation, which change sign from site to site with zero average, i.e. 



< a a (i) >=m(i). (2) 
In this case the system average of the magnetisation, i.e. 

m = ^i.* (3 ) 

is not informative. On the contrary if we look to a two replicas quantity (for a ^ fe), we find 
the rather interesting results: 

= Ei=i,jy < <7a(i)<7b(i) > _ Ei=i,jyra(0 2 . . 

Qa,b - N - N (4j 

In the nutshell we use one replica to probe the properties the other replica. Correlations 
functions among different replicas (averaged over the system) bring information to us on the 
properties of the ground state of the system although they are not sufficient to determine the 
ground state. 

Using this formalism we accomplish two goals: 

• If we measure the correlations among replica and not the ground state directly, we have 
quantities which should be more stable when we perturb the system. 

• If we succeed to write down theoretical relations for the correlations among different 
replicas, we can use them to solve the model without having to compute the ground 
state. 

2.2 The breaking of replica symmetry 

Things are more complicated if we have more than one ground state. For example for Ising 
spins in absence of magnetic field there are always two possible values of the magnetisation, 
which are obtained by changing the sign to all the spins. 

Usually we cure this problem by adding a small magnetic field, but this does not always 
solve the problem, e.g. it does not solve the problem in the case of an antiferro magnet. In this 
case one finds that 

< a a (i)a b (i) >= 0, (5) 

because the four (two for the replica a and two for the replica b) states of give an exactly equal 
in modulus and cancelling contribution. 

The solution is simple: for example in the case n = 2 we consider the following Hamiltonian 

[4, 5, 6, 7] : 

H = H{a 1 ) + H(a 2 ) -6^^(1)^(1), (6) 

i 

and we study its properties for small e. 

Now the Hamiltonian is invariant under the change of both the first and the second replica 
together. If there are two states, having magnetisation ±.m(i) one finds 

lim q{e) = — lim q{e) 



q(e) = Ei=i,7V < ^y^) >e (7) 
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By adding a term which couples different replicas and observing if the correlations among 
replicas are continuous or discontinuous when this parameter change sign, we can monitor the 
existence of one of more equilibrium states. Just because the equivalence among replicas is 
destroyed by an infinitesimal field where more than one equilibrium state is present, we say 
that in this situation replica symmetry is spontaneously broken [1, 2]. 

It is evident that if we should consider only the case in which the equilibrium states differ 
by a simple symmetry transformation, the replica formalism would be correct, but may be not 
so useful. The real power of the replica formalism shows up when there are many equilibrium 
states of different free energy. In one of the most simple non trivial cases which can be studied 
by using this formalism, there are many equilibrium states and the probability of finding a 
state with free energy F = AF + F (F is the free energy of the lowest lying state) increases 
as 

P(AF) oc exp(/3mAF), (8) 

where the parameter m characterize the way in which the replica symmetry is broken [1, 2]. 
This case is usually called one step breaking. 

There is an algebraic formulation of the replica method in which one encodes the informa- 
tion coming from the structure of the states in correlations among replicas. The n replicas are 
divided in groups in such a way that correlations among replicas belonging in the same group 
are the same. For example in the previous case of one step replica symmetry breaking, one 
divides the n replicas in n/m groups of m replicas each. This construction may look rather 
artificial, but it turns out to be an extremely efficient way of describing in a compact way rather 
complex situations. Moreover this formulation is well suited for doing computations [1, 2]. It 
may take some work to do the decoding and to find out which are the physical properties of the 
state distribution from the assumed for of replica symmetry breaking; however this decoding 
is always possible and the structure of the probability distribution of the states mirrors the 
structure of the algebraic properties of the replicas. 

3 Mean field results 

In these recent years there have been many progresses on the understanding of the behaviour 
of glassy systems in the mean field approximation. The main results have been obtained for 
the following cases: 

• Models with random quenched disorder have been well understood also from the dynam- 
ical point of view. 

• Models with random quenched disorder, which display a glassy transition quite similar 
to that of the previous models. Some of the results obtained for systems with random 
quenched disorder have been extended also to these systems. 

Let us see what happened in more details. 

3.1 Systems with quenched disorder 

Generally speaking when the interaction range is infinite, the thermodynamical properties at 
equilibrium of a spin model can be computed analytically. When the system is disordered, we 
must use the replica method [1,2]. A typical example of a model which can be solved with the 
replica method is a spin model with p spin interaction. The Hamiltonian we consider depends 
on some control variables J, which have a Gaussian distribution and play the same role of the 
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random energies of the REM and by the spin variable a. For p — 1,2,3 the Hamiltonians are 
respectively 



= ^2 JiOi\ Hj(a) = Ji,k<7i&k', Hj(a) = Ji,k,iO'iO'kO~i , (9) 

i=l,N i,k=l,N i,k,l=l,N 

where the primed sum indicates that all the indices are different [8, 9]. The N variables J 
must have a variance of 0(N^ 1 ~ P '' 2 ) in order to have a non trivial thermodynamical limit. The 
variables a are usual Ising spins, which take the values ±1. From now on we will consider only 
the case p > 2. 

In the replica approaches one assumes that at low temperatures the phase space breaks 
into many valleys, (i.e. regions separated by high barriers in free energy). One also introduces 
the overlap among valley as 

9(«,7) = ^ , (10) 

where a a and a 7 are two generic configurations in the valley a and 7 respectively. 

In the simplest version of this method [8, 9] one introduces the typical overlap of two 
configurations inside the same valley (sometimes denoted by Qea)- Something must be said 
about the distribution of the free energies of the valleys. Only those which have minimum free 
energy are relevant for the thermodynamics. One finds that these valleys have zero overlap 
and have the following distribution of the total free energy F: 

P(F) oc exp(/3m(F - F )). (11) 
The two parameters, q and m give complementary information: 

• The parameter q tell us how much two generic configurations in the same valley are 
similar one to the other; with this normalization q should go to 1 to zero temperature. 

• The parameter m tell us how much the different valley differs in free energy. If we assume 
that the free energy differences remain finite when the temperature goes to zero, m is 
proportional to the temperature at small temperature. 

The two parameters q and m are enough to characterize the behaviour the system. Indeed 
the average value of the free energy density (/) can be written in a self consistent way as 
function of m and q (f(q,m)) and the value of these two parameters can be found as the 
solution of the stationarity equations: 

dm dq ^ ^ 

The quantity q is of order 1 — exp(— Af3p) for large p, while the parameter m is 1 at the 
critical temperature, and has a nearly linear behaviour al low temperature. 

The thermodynamical properties of the model are the same as is the Random Energy 
Model [10] (indeed we recover the REM when p — > 00 [8] ): there is a transition at T c with a 
discontinuity in the specific heat, with no divergent susceptibilities. 

A very interesting finding is that if we consider the infinite model and we cool it starting 
at high temperature, there is a dynamical transition at a temperature T D > T c [1 1]- [16] . At 
temperatures less than T D the system is trapped in a metastable state with energy greater 
than the equilibrium energy. The existence of these infinite mean life metastable states is one 
of the most interesting results for these models. The correlation time (not the equilibrium 
susceptibilities) diverges at T D and the mode-mode coupling become exact in this region. 
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3.2 Systems without quenched disorder 

We could ask how much of the previous results can be carried to models without quenched 
results. It has been found in the framework of the mean field theory (i.e. when the range of 
the interaction is infinite), that there a the partial equivalence of Hamiltonians with quenched 
and random disorder. More precisely it often possible to find Hamiltonians which have the 
same properties (at least in a region of the phase space) of the Hamiltonian without disorder 
[17] - [23] . An example of this intriguing phenomenon is the following. 

The configuration space of our model is given by iV Ising spin variables [17]. We have a 
line of line of length iV and on each site there is an Ising variable cr(i). The Hamiltonian is a 
four spin antiferromagnetic interaction 

H = N~ 1 ]T a(i)a(k)a(j)a(l), (13) 

where the sum is restricted to the sites that satisfy the condition i + k =n j + I (where = N 
stand for congruent modulus N). This Hamiltonian has been proposed in the study of low 
autocorrelation sequences. With some work it can be rewritten as: 

H= E \Bi\ 2 -M 2 , (14) 

i=l,N 

where B { = ^ R i,k°k- (15) 

k=l,N 

Here R is an unitary matrix, i.e. 



/] Ri,kRk,m — $i,m- (16) 
k=l,N 



which in this particular case is given by 



exp(27ri km) 



R(k,m)= ^ m/2 ' (17) 

We could consider two different cases [17] : 

• The matrix R is a random orthogonal matrix. 

• The matrix R is given by eq ( 17 ). 

The second case is a particular instance of the first one, exactly in the same way that a 
sequence of all zeros is a particular instance of a random sequence. 

The first model can be studied using the replica method and one finds results very similar 
to those of the p-spin model we have already studied. 

Now it can be proven that the statistical properties of the second model are identical to 
those of the first model, with however an extra phase. In the second model (at least for some 
peculiar value of N, e.g. N prime [17, 18] ) there are configurations which have exactly zero 
energy. These configuration form isolated valleys which are separated from the others, but 
have much smaller energy and they have a very regular structure (like a crystal). An example 
of these configurations is 

o k =n A: (7V ~ 1)/2 (18) 

(The property k( N ~^ = 1 for prime N , implies that in the previous equations = ±1). 
Although the sequence given by the previous equation is apparently random, it satisfies so 
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many identities that it must be considered as an extremely ordered sequence (like a crystal). 
One finds out that from the thermodynamical point of view it is convenient to the system to 
jump to one of these ordered configurations at low temperature. More precisely there is a first 
order transition (like a real crystalization transition) at a temperature, which is higher that 
the dynamical one. 

If the crystallisation transition is avoided by one of the usual methods, (i.e. explicit in- 
terdiction of this region of phase space or sufficient fast cooling), the properties of the second 
model are exactly the same of those of the first model. Similar considerations are also valid for 
other spin models [19, 20, 21] or for models of interacting particles in very large dimensions, 
where the effective range of the force goes to infinity [23, 22] . 

We have seen that when we remove the quenched disorder in the Hamiltonian we find a 
quite positive effect: a crystallisation transition appears like in some real systems. If we neglect 
crystalization, which is absent for some values of N, no new feature is present in system without 
quenched disorder. 

These results are obtained for long range systems. As we shall see later the equivalence 
of short range systems with and without quenched disorder is an interesting and quite open 
problem. 

4 Some considerations on real glasses 

Here we will select some of the many characteristics of glasses we think are important and 
should be understood. The main experimental findings about glasses that we would like to 
explain are the following: 

• If we cool the system below some temperature (Tq), its energy depends on the cooling 
rate in a significant way. We can visualize T G as the temperature at which the relaxation 
times become of the order of a hour. 

• No thermodynamic anomaly is observed: the entropy (extrapolated at ultraslow cooling) 
is a linear function of the temperature in the region where such an extrapolation is 
possible. For finite value of the cooling rate the specific heat is nearly discontinuous. 
Data are consistent with the possibility that the true equilibrium value of the specific 
heat is also discontinuous at a temperature T c lower than T G . The difference of the 
entropy among the glassy phase and the crystal seems to vanish approximately at T c . 

• The relaxation time (and quantities related to it, e.g. the viscosity) diverges at low 
temperature. In many glasses (the fragile ones) the experimental data can be fitted as 



where r ~ 10 s is a typical microscopic time, T c is near to the value at which we could 
guess the presence of a discontinuity in the specific heat and the exponent A is of order 
I. The so called Vogel-Fulcher law [25] states that A = 1. The precise value of A is not 
well determine. The value 1 is well consistent with the experimental data, but different 
values are not excluded. 

Now the theoretical interpretation of these results is quite clear (quite similar phenomena 
happens also in spin glass models in the mean field limits, where they can have been very 
carefully studied both numerically and analytically). When we go near to the glassy phase the 



T = T e W (PB(T)) 
B(T) oc (T-T c )- A 



(19) 
(20) 
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system may be frozen in many different configurations whose number is exponentially large. 
The entropy density can thus be written as 

S(T) = S C (T) + W(T), (21) 

where S C (T) is the entropy inside each of these configurations (which is likely not too different 
from that of the crystal) and W(T) is proportional to the logarithm of the total number of con- 
figurations (i.e. it is the configurational entropy, called sometimes also complexity [24] ). The 
complexity vanishes linearly when T approaches T c and remains zero at smaller temperature. 
This fact implies a the presence of thermodynamic transition at T = T c . 

The viscosity is dominated by the hopping from one equilibrium to an other equilibrium 
configuration. The number of equilibrium configuration decrease when T — > T c and therefore 
the number of particles that are involved in each hopping process must increase. The free 
energy barriers for such a process increases at the same time and diverges at T c ; the precise 
way in which they diverge it is a highly debated problem. 

A consequence of this picture is that below T c there number of different equilibrium con- 
figurations (which contribute to the partition function) should not be anymore exponentially 
large. In this region replica symmetry should be broken, i.e. an arbitrarily small force should 
be enough to keep together two different replicas for an arbitrary large time. 

The replica formalism seem therefore well suited to capture the phase transition in glasses. 
At this moment it is not clear which is best way in which this formalism must be used. We 
shall see in the next section a possible application. 



5 Toward real glasses 

It is interesting to find out if one can construct approximation directly for the glass transitions 
in liquids. Some progresses have been done in the framework of mean field theory in the infinite 
dimensional cases. Indeed the model for hard spheres moving on a sphere can be solved exactly 
in the high temperature phase when the dimension of the space goes to infinity in a suitable 
way [23, 22]. 

One of the most interesting results is the suggestion that the replica method can be directly 
applied to real glasses. The idea is quite simple. We assume that in the glassy phase a finite 
large system may state in different valleys, labeled by 7. The probability distribution of the 
free energy of the valley is given by eq. (8). We can speak of a probability distribution because 
the shape of the valleys and their free energies depends on the total number of particles. Each 
valley may be characterized by the density 

p(x) 7 =< p{x) > 7 (22) 

In this case we can define two correlation functions 



Jdy < p(y)p(y + x) > 7 
V 



„ (n .\ _ S d y< p(v) >7< p(y + x) 

9R{%) - y , l^J 

where for simplicity we have assumed that the density of the particles is 1. 

A correct description of the low temperature phase must take into account both correlation 
functions. The replica method does it quite nicely: g is the correlation function inside one 
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replica and g R is the correlation function among two different replicas. 

Jdy < pa(y)p a (y + x> 



g(x) 



V 



g R (x) = S dy < PajxWy + x) > a ^ ^ (24) 

where here a and b label the replica and p a (x) is the density of particles of the replica a. 

This would be more or less the traditional approach if we assume the existence of only one 
valley for the system. On the contrary if we assume that the state may be in many different 
valleys we have to say something about the free energy distribution of free energy of the valleys. 
This can be done using the replica method and using the variable m, defined in eq. (11), which 
characterize the probability distribution of the free energy of those valley having a value of the 
free energy near the minimum. 

The problem is now to write closed equations for the two correlation functions g R and g. 
Obviously in the high temperature phase we must have that g R = 1 and the non-vanishing of 
g R — 1 is a signal of entering in the glassy phase. 

The first attempt in this direction was only a partial success [26] and it will be described 
in the appendix. A generalized hypernetted chain approximation was developed for the two 
functions g and g R . 

The replica formalism provides and automatic bookkeeping of all complications which would 
arise from the existence of many states. If one assumes a given form for replica symmetry 
breaking, it correspond to a given form for the probability distribution of the w. In the 
simplest case, called one step breaking, one divides the n replicas in n/m groups of m replicas 
and one assumes the following structure of correlation functions: 

< p a (x)pa(y) > = g(x-y) , 

< p a (x)p b (y) > = g R (x — y) for a ^ b in the same group , 

< p a (x)pb(y) > = 1 for a and b in different groups. . (25) 

Fortunately enough the results for the free energy density (per replica) do not depend on n so 
that we do not have to specify this (unphysical) parameter. 

A non trivial solution was found at sufficient low temperature both for soft and hard spheres 
and the transition temperature to a glassy state was not very far from the numerically observed 
one. Unfortunately the value of the specific heat at low temperature is not the correct one (it 
strongly increases by decreasing the temperature). Therefore the low temperature behaviour 
is not the correct one; this should be not a surprise because an esplicite computation show 
that the corrections to this hypernetted chain approximation diverge at low temperature. 

These results show the feasibility of a replica computation for real glasses, however they 
point in the direction that one must use something different from a replicated version of the 
hypernetted chain approximation. At the present moment it is not clear which approximation 
is the correct one, but I feel confident that a more reasonable one will be found in the near 
future. 



Appendix 

We consider a system of N interacting particle in a volume V. We study the infinite volume 
limit in which iV — * oo at fixed p = N/V. The Hamiltonian is given by: 

H(x) = Y,U{x i -x k ). (26) 
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We will consider a soft sphere case U(x) = r~ 12 . We will work at density one and we will 
introduce the parameter V = f3 4 . 

In this case the glass phase may be reached only with a very fast cooling rate, otherwise 
the system goes into the crystal phase. This difficulty may be easily removed by considering a 
binary mixture, but this problem is not relevant here. 

The hypernetted chain (HNC) approximation consists in considering only a given class of 
diagrams in the virial expansion [27]. It gives a reasonable account of the liquid phase. We will 
consider here this approximation because it has the advantage of having a simple variational 
formulation. In the liquid phase, where the density is constant, the usual HNC equation (for 
the non replicated system) can be written as 

g(x) = exp (-(3U(x) + W{x)) , (27) 

where: 

g{x) = (1 + h{x)) =< p(x)p(0) > -5(x), 

W(x) = [ e-*> h( ff , , (28) 
V J J (2vr) d 1 + h(p) V ; 

and we denote by h(p) the Fourier transform of h(x) = g(x) — 1. 

This equation can be derived by minimizing with respect to g(x) the following free energy 
per unit volume, in the space of functions of \x\: 

(3F = J d d x g(x)[Hg(x)) - 1 + (3U{x)\ + j ^L(h(g)), (29) 

where L(x) = — ln(l + x) + x — x 2 /2. 

The HNC equation gives a description of the liquid phase which is not perfect, but precise 
enough for our purpose: The energy (or equivalently the pressure), does not depart more than 
15% from the correct value, and the correlation function is also well reproduced (see fig. ( 1 

))• 

In [26] it was proposed a bold generalization of the HNC equations for n replicas. The 
replicated free energy is now 

PF = j d d xJ29a b (x)[H9ab(x)) ~ 1 + PU(x)S a>b ] + TrL(h), (30) 

a,b 

where h is now an operator both in x space and in replica space. 

If one finds that at low enough temperatures there is a solution of the variational equations 
5F/5g a> b = 0, where g a b is non zero off the diagonal, replica symmetry is broken. In the case 
where g a b is of the form shown in eq. (25), this equation can be used to compute the properties 
of the correlation function in the glassy phase. This approach amounts to a study of the density 
modulations in the glass phase at the level of the two point function. In the glass phase p 7 (x) 
becomes space dependent. However, as argued in the introduction, the necessity of averaging 
over the states 7 forces us to study this x dependence at the level of the two point correlations. 
So our correlation gn reflects the structure of p 7 (a;) as a sum of peaks of unit weights, smoothed 
by the average over states. 

Within the one step breaking scheme (25), the free energy per replica is: 

/3F = J d d x{g(x)[Hg(x)) - 1 + PU(x)] - (1 - m)g R (x)[Hg R (x)) - 1]} 

" / wr & {q)2 m)Mg)2 ~ Hq) 

1 1 — m \ 

+ - ln[l + h(q) - (1 - m)h R (q)} ln[l + h(q) - h R (q)}. (31) 

m m J 
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1.5 2 2.5 3 



Figure 1: The correlation function of a system of soft spheres as a function of the distance at 
the dimensionless inverse density T = 1.6 corresponding to the glassy transition: numerical 
simulations (points) and replica symmetric HNC equation (full line). 



Two transitions can be found: the static and the dynamical transition. 

• The static transition is identified as the temperature (or density) at which there exists a 
non trivial solution to the replicated HNC equations : 

!)/ 5F/5g R (x) = Q (32) 



5g(x) = 
and 

dF/dm = 0, (33) 

for m G [0, 1] (in fact we must minimize the free energy with respect to g, but maximize 
with respect to gn and m). 

• The dynamical transition may be characterized as the highest temperature at which there 
is a non trivial solution of the two stationarity equations SF/5g(x) = and 5F/5gR(x) = 
at m = r. The corresponding equations are obtained by substituting m — > 1 in the 
first two equations of (32). The equation for g is identical to the usual HNC equation 
(28), while gn is a solution of Qr{x) = exp(Wji(x)), with Wr can be extracted from the 
second equation of (32) at m — 1. 

If we look for the numerical solution of the replicated HNC equations, we find a dynamical 
transition at V ~ 2.05, and a static replica symmetry breaking solution at V ~ 2.15. In 
numerical simulations the glass transition is found at a smaller value of T, namely T = 1.6. In 
the glass phase, the correlation function g\(r) is essentially a smoothed form of the function 
g(r) plus an extra contribution at short distance which has integral near to 1 (see Fig.2). This 
form seems very reasonable: considering the definition (23) of g^, we see that it basically 
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0.5 1 1.5 2 2.5 3 3.5 4 

Figure 2: The correlations g(r) (full line) and gn(r) (broken line) as functions of the distance, 
for soft spheres at the density where replica symmetry is broken (e.g. 7 = 2.15) 

characterizes the average over 7 of the product p-y(x)p 7 (y), which is precisely expected to have 
this kind of peak structure. 

In spite of this nice form for g^, this solution has some problems. A first one is found on the 
value of the energy. Although there is a discontinuity in the specific heat at T c , it is extremely 
small and the final effects on the internal energy are more or less invisible. The specific 
heat remains extremely large. Moreover the value of m has a very unusual dependence on the 
temperature. In all the known models with one step replica symmetry breaking, the breakpoint 
m varies linearly with T at low temperatures. Here we have a very different behaviour. We have 
also computed the dynamical internal energy and found out that it differs from the equilibrium 
one by an extremely small account. 

If we consider the qualitative behavior of the correlation functions, we find a reasonable 
form, on the other hand the energy in the glassy phase turns out to be quite wrong. This 
computation should be considered only as a first step and work is in progress to find another 
approximation (different from the replicated HCN) which should be similar in spirit, but 
technically more sound. 
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